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The  ever  increasing  need  to  be  informed  has  caused  an 
ever  increasing  volume  of  publications.  The  very  quantity 
of  these  publications,  however,  makes  it  difficult  to  satis¬ 
fy  the  need,  because  it  becomes  more  and  more  arduous 
to  locate  the  literature  pertinent  to  any  one  subject;  and 
because  any  one  of  us  becomes  more  and  more  weary  of 
having  so  much  to  read.  Moreover,  only  a  small  minority 
of  these  publications  may  help  satisfy  the  need,  because 
an  overwhelming  majority  is  void  of  content. 

Consequently,  it  is  imperative  to  present  to  the  public 
only  manuscripts  which  do  carry  new  information  without 
undue  verbiage;  hoping  to  be  judged  not  by  the  number 
of  published  pages  but  by  their  quality.  In  particular, 
papers  in  the  field  of  Applied  Mathematics  ought  to  be 
published  only  if  they  contain  one  or  more  of  the  follow¬ 
ing  items:  new  basic  results,  new  methods,  new  applicat¬ 
ions,  new  numerical  results,  new  presentation  of  difficult 
and  important  topics,  up-to-date  bibliographies;  and  if 
the  number  of  their  pages  is  not  dictated  by  the  desire  of 
imposing  upon  the  superficial  reader. 

To  discharge  our  contractual  obligations,  we  publish 
Technical  or  Scientific  Reports,  such  as  the  one  you  now 
have  in  your  hands.  It  has  been  our  constant  policy  to 
see  to  it,  that  they  satisfy  the  above  strict  criterion. 
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ABSTRACT 


An  abstract  covering  problem  is  formulated  which  includes  as  special 
cases  the  prime  implicant  problem,  the  usual  set-theoretic  covering  and 
systems  of  representatives  problems,  and  the  problems  of  externally  stable 
sets,  1-widths  of  matrices  and  minimal  including  sums.  The  known  methods  of 
solution  are  extended  to  the  general  case. 
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Basic  Features  Common  to  Some 
Combinatorial  Covering  Problems 


by 


J.  A.  Riley 


1.  Introduction.  The  most  basic  problem  in  the  theory  of  minimization 
of  Boolean  formulas  is  that  of  finding  the  minimal  normal  formulas 
representing  a  given  Boolean  function.  The  known  methods  for  solving 
this  problem  all  consist  essentially  of  the  following  two  steps:  first, 
find  the  irredundant  normal  formulas  representing  the  function,  and  then, 
second,  use  the  preassigned  criterion  of  minimality  to  extract 
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the  minimal  formulas  from  the  list  of  irredundants .  It  is  well  known 
that  the  components  of  an  irredundant  normal  formula  are  prime  impli- 
cants ;  the  problem  of  finding  the  irredundant  equivalents  of  a  given 
function  breaks  up,  then,  into  two  further  problems:  that  of  computing 
the  prime  implicants  of  the  function,  and  that  of  finding  those  unions 
of  prime  implicants  which  are  irredundant  equivalents.  The  problem  of 
finding  the  prime  implicants  of  a  given  function  has  been  solved  in 
more  or  less  satisfactory  fashion,  depending  on  the  data  in  terms  of 
which  the  function  is  specified.  Of  course,  in  practice,  enormous 
difficulties  may  be  encountered,  the  point  being  that  there  are  functions 
in  not  too  many  variables  which  have  literally  thousands  of  prime 
implicants.  Nevertheless,  there  does  not  seem  to  be  too  much  room  for 
improvement  in  the  existing  algorithms.  A  much  more  serious  problem 
is  encountered  in  the  second  step  of  the  program,  that  of  computing 
the  irredundant  equivalents.  The  bulk  of  the  succeeding  sections  will 
be  taken  up  with  descriptions  of  the  known  methods  of  solution  of  this 
problem.  These  are  essentially  three  in  number,  (if  we  except  the 
McCluskey-Pyne  attempt  to  use  the  methods  of  linear  programming; 
see  [16]),  a  'naive'  trial  and  error  process,  the  'Boolean  algebra' 
or  'multiplying-out '  method,  and  the  'branching'  technique.  In  one 
form  or  another  the  basic  ideas  of  these  methods  underlie  all  known 
procedures  and  algorithms  for  finding  irredundant  normal  formulas. 

In  the  course  of  our  work  on  these  problems,  we  had  devised 
several  procedures  which,  at  first  sight,  appeared  to  be  quite  promis¬ 
ing.  On  closer  examination,  however,  these  turned  out  to  differ  only 
trivially  from  one  or  the  other  of  the  methods  just  mentioned. 

The  fundamental  difficulty  in  applying  each  of  these  methods  is 
that  they  each  require  the  generation  of  many  more  formulas  than  are 
actually  found  to  be  irredundant,  that  is,  none  of  these  three  methods, 
it  seems,  goes  to  the  heart  of  the  matter  in  as  direct  a  fashion  as 
would  be  desirable.  It  should  be  mentioned  that  if  minimal  formulas 
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are  what  are  desired,  the  minimality  criterion  may  be  applied  at 
various  intermediate  points  in  the  computations;  this  has  the  effect 
of  weeding  out  more  quickly  those  formulas  which  would  eventually  be 
found  to  be  non-minimal.  Even  so,  the  problem  still  remains  -  to 
devise  a  procedure  which  will,  in  some  sense,  avoid  the  necessity  of 
considering  a  host  of  superfluous  formulas,  and  give  the  desired 
irredundant  and/or  minimal  formulas  in  a  straight  forward,  effective 
fashion. 

This  is  obviously  a  vague  objective;  it  may  even  have  been 
attained.  By  this  1  mean  that  it  could  be  maintained,  without  obvi¬ 
ous  objection,  that  the  Boolean  algebra  and  branching  methods  are 
themselves  optimal  or  near-optimal,  at  least  as  far  as  the  computation 
of  irredundants  is  concerned.  However,  we  feel  that  there  is  merit 
in  attempting  to  improve  and  extend  these  algorithms.  At  the  very 
least,  we  may  discover  various  improvements  in  detail  which  would  make 
the  concrete  applications  of  the  methods  more  tractable. 

In  view  of  the  preceding  remarks,  therefore,  we  have  undertaken 
to  survey  the  published  literature  on  these  subjects,  and  to  try  to 
extract  the  essence  of  what  has  been  accomplished.  The  following 
sections  constitute  a  first  draft  of  our  findings.  Very  early  in  our 
work,  we  discovered  the  already  more  or  less  well  known  fact  that  our 
problems  are  abstractly  identical  with  other  combinatorial  problems, 
currently  under  study,  such  as  set-theoretic  covering  problems,  the 
"prime  implicant"  problem,  the  theory  of  minimal  including  sums,  and 
the  theory  of  "l-widths"  of  matrices  of  0's  and  l's.  This  abstract 
identity  consists  in  the  fact  that  each  of  these  problems  is  a  special 
case  of  a  more  general  abstract  "covering"  problem,  which  we  present 
in  section  2.  The  methods  used  by  various  authors  for  solving  the  con¬ 
crete  problems  are  themselves  capable  of  being  abstracted  to  give 
methods  for  solving  our  general  problem.  In  sections  4,  5  and  6  we 
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give  our  abstract  version  of  these.  In  section  U  we  give  what  we  feel 
is  a  useful  mathematical  framework  for  the  discussion  of  such  problems. 

In  section  7  we  turn  to  a  special  case  -  the  problem  of  minimal  includ¬ 
ing  sums.  We  show  how  the  multiplying  out  method  may  be  combined  with 
Gazale's  method  of  "fractions"  to  yield  an  interesting  method  of  finding 
minimal  including  sums. 

.  Our  presentation  is  necessarily  very  sketchy,  our  main  purpose 
being  sir.iply  to  present  what  we  feel  is  the  essence  of  these  concrete 
covering  problems.  For  the  purpose  of  maintaining  contact  with  the 
literature  we  give  in  section  3  a  list  of  these  concrete  problems, 
together  with  an  indication  of  how  they  fit  into  our  general  framework. 

We  have  not  attempted  to  write  a  complete  "comparative  anatomy"  of  the 
literature,  but  have  limited  ourselves  here  to  an  occasional  remark  at 
the  appropriate  point  in  our  discussion. 

The  list  of  bibliographical  references  at  the  end  is  not  known  to 
be  complete;  we  present  it  simply  as  an  adequate  and  useful  collection 
of  source-material  discussed  here. 

2.  The  Abstract  Covering  Problem.  Let  R,  C  be  finite  sets,  and  f  :  R— *  C 

a  relation  between  R  and  C  ,  i.e.  a  multiple  valued  mapping  from  R  to 

C  .  We  will  assume  that  J>  is  onto. i.e.  that  each  element  «  of  G  is 
contained  in  fir)  ,  for  some  T6  R  .  We  will  also  assume  that  the  domain 
of  p  is  the  whole  of  R  .  If  re  R  and  c  e  C  ,  we  will  say  that  c 
covers  X  if  C «  f(r)  .  A  subset  O'  of  C  is  a  cover  of  R  if  for 

each  ffcR,  fiO  ft  C*  is  not  empty,  i.e.  if  each  element  of  R  is 

.  «  it  .4  . 

covered  by  at  least  one  element  of  G  .  If  G  ,  C  are  covers  of  K, 
and  C  £  G'  ,  then  C"  is  called  a  sub -cover  of  C  .  It  is  obvious 

that  G  is  a  cover  of  R  and  that  any  cover  of  R  is  a  sub-cover  of  C. 

A  cover  C'  of  R  is  said  to  be  irredundant  if  no  proper  subset 

of  C*  is  a  cover.  It  is  easy  to  see  that  any  cover  of  R  contains  an 

irredundant  sub-cover. 

Our  first  covering  problem  is:  (i)  Find  the  irredundant  covers  of  R. 
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Conceptually,  of  course,  this  problem  has  a  trivial  solution,  viz. 
list,  in  some  order,  all  of  the  covers  of  R  ,  and  then  pick  out  those 
which  are  irredundant.  In  practice,  however,  such  a  procedure  is 
almost  never  practicable;  what  is  needed  is  a  method  of  circumventing 
this  exhaustive  listing. 

A  second  problem,  possibly  even  more  important  for  the  applications, 
is  that  of  finding  minimal,  weighted  covers. 

A  cost  function ,  Y1  on  t  ,  is  a  map  which  associates  to  each  sub¬ 
set  5  of  C  a  non-negative  real  value,  Y(S)  :  the  "cost"  of  S. 

We  assume  in  addition  that  satisfies  the  axiom:  if  S’£  S  ,  then 

JT’CS'J  —  >*<.»>)  ,  with  equality  only  if  51  »  S  .  A  cover,  C'  ,  of  R 

is  said  to  be  Y  -minimal  if  for  any  other  cover  C"  ,  K*Cc')—  If1  C C ** J . 

It  is  easy  to  see  that  a  Y  -minimal  cover  is  necessarily  irredundant 
(although  the  converse  is  not  true). 

Our  second  covering  problem  is  then:  ( II )  Find  the  if -minimal 
covers  o£  R  . 

The  remarks  made  above  concerning  the  impracticality  of  starting 
with  an  exhaustive  list  of  all  covers  also  apply  here.  What  is  needed 
here  also  is  a  more  refined  method  for  finding  minimal  covers  -  one 
which  does  not  require  at  the  outset  a  listing  of  all  covers. 

A  possible  solution  consists  in  first  computing  the  irredundant. 
covers;  we  have  noted  above  that  any  V  -minimal  cover  is  irredundant. 

The  minimal  ones  may  then  be  located  by  inspection. 

In  many  cases  of  practical  interest,  the  number  of  irredundant 
covers  is  uncomfortably  large,  so  that,  again,  it  would  be  desirable 
to  find  methods  of  computing  minimal  covers  directly. 

It  is  possible  to  combine  both  problems  (i)  and  (il)  into  a  single 

more  general  one  by  introducing  an  abstract  order  relation  into  the 

collection  of  subsets  of  G  Precisely,  we  will  assume  the  existence 

••  •) 

of  a  "pre-order"  relation,  which  we  will  denote  by  —  on  the  subsets 
of  C  ,  and  which  satisfies  the  following  axioms: 
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a)  6  £.  S  for  all  subsets  S  of  C  ; 

b)  if  3  -  T  and  T—  U  ,  then  S*\J. 

c)  if  S'  c  $  ,  then  S'  £  S  ,  and,  in  this  case.  Si  S' 
only  if  S  -  S' . 

It  is  easy  to  see  that  the  relations  of  set-inclusion,  and  of 
"cost  less  than  or  equal  to"  are  concrete  instances  of  the  pre-order  relation 
It  is  important  to  notice  that  we  have  deliberately  not  assumed  that 
S‘  ±  $  and  Si  S'  together  imply  that  S  -  S’  .  This  last  property 
is  one  of  the  usual  requirements  for  a  so-called  partial  order  relation. 

The  relation,  £  of  set-inclusion  does,  of  course,  possess  this  property 
of  'exclusivity;'  the  cost  relation,  however,  does  not,  since  it  is 
possible  for  distinct  subsets  to  have  the  same  cost. 

In  terms  of  £L  ,  a  £  -minimal  cover  C  will  be  one  which  satisfies 
the  property  :  if  O'  is  any  cover  of  R  such  that  C  —  C  ,  then  in 
addition,  C'f  C"  . 

Specialization  of  this  notion  yields  immediately  the  notions  of 
irredundant,  and  of  Y  -minimal  cover.  We  point  out  that  in  view  of 
axiom  c),  any  —  -minimal  cover  is  also  an  irredundant  cover  of  ft- 

The  general  covering  problem  with  which  we  will  be  concerned  here 
is  then  the  following,  and  includes  (i)  and  (il)  as  special  cases: 

(ill)  Find  the  £  -minimal  covers  of  R  . 

Since  —  -minimal  covers  are  irredundant,  we  again  have  a  first 
tentative  solution  :  find  the  irredundant  covers,  and  then  weed  out 
those  which  are  not  —  -minimal . 

In  the  following  sections  we  will  adapt  the  known  methods  for 
finding  irredundant  and  minimal  covers  to  our  more  general  situation. 

We  point  out  here  that  Roth  [2]  has  given  an  algorithm,  the  so- 
called  "extraction"  algorithm,  for  solving  a  very  general  covering 
problem.  His  problem  is  essentially  the  same,  in  another  terminology, 
as  our  abstract  version,  the  only  difference  being  that  he  allows  for 
the  presence  of  "don't-care"  conditions;  we  may  express  this  by  saying 
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that  the  domain  of  p  la  not  neceaaarily  the  whole  of  R  . 

The  algorithm  itself,  translated  into  our  framework,  is  exactly 
the  branching  technique,  to  be  discussed  in  section  6. 

3.  Examples.  In  this  section  we  collect  a  number  of  examples  from 
the  current  literature  which  may  be  interpreted  as  covering  problems 
and  which  fall  within  our  abstract  framework. 

Example  A.  Set  theoretic  coverings.  If  is  a 

finite  set,  and  C  *  t  cn  \  is  a  collection  of  subsets  of  R 

such  that  R=  c(u  ...  u  c„  ,  then  C  is  called  a  cover  of  R  .  A  sub¬ 
set,  G'  ,  of  C  is  a  sub -cover  of  C  if  R  =  u  ^c\c  <  j 
i.e.  if  each  element  of  R  belongs  to  at  least  one  set  in  C  .  Denote 
by  l  C'l  the  cardinality  of  C*  ,  i.e.  the  number  of  sets  which  it 
contains.  Then  the  minimal  covering  problem  is  :  find  the  minimal  sub¬ 
covers  of  C  ,  i.e.  those  sub-covers  of  smallest  cardinality.  To  show 
that  this  problem  is  a  special  case  of  our  general  one  is  easy  :  we 
define  f  (v)  to  be  the  collection  of  sets  c*  in  C  which  contain  r  , 
and  we  define  S' -  S  to  mean  that  S'  has  fewer  sets  than  5. 

Edmonds  [3]  gives  an  interesting  extension  to  these  set-theoretic 
covering  problems  of  the  Berge-Norman-Rabin  theory  (see  [4]  and  the 
references  given  there)  for  minimal  coverings  of  a  graph.  It  seems 
that  any  covering  problem  may  be  transformed  into  a  variant  of  the 
covering  problem  for  graphs;  the  Berge-Norman-Rabin  technique  is  then 
generalized  to  obtain  some  information  concerning  the  structure  of 
minimal  covers.  We  have  not  included  any  discussion  of  this  theory 
here  both  because  it  lies  in  somewhat  different  direction  and  because 
a  definite  algorithm  for  finding  minimal  covers  has  not  yet  been  obtain¬ 
ed  (for  the  general  problem,  that  is;  the  Berge-Norman-Rabin  theorem 
(cf.  [4])  yields  a  more-or-less  explicit  algorithm  for  the  "ordinary" 
covering  problem  for  graphs). 
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Example  B.  Systems  of  Representatives.  Let  baa 

finite  collection  of  finite  sets  *V*  and  let  C  denote  the 

union  of  the  sets  in  R,  C  Wt  «  R  ^  .  A  subset  C  Cr) 

is  a  sys  tern  of  representatives  of  R  if  each  set  r*  1b  R  contains  at 
least  one  tj  from  C'  .  An  irredundant  system  of  representatives  is  one 
such  that  no  proper  subset  of  it  is  also  a  system  of  representatives. 

One  problem  which  may  be  posed  is  to  find  the  irredundant  systems  of 
representatives  of  R  .  If  a  cost  function  is  defined  by  attaching  a 
cost  or  weight  to  each  element  of  G  /we  may  pose  the  problem  of 
finding  the  systems  of  representatives  of  smallest  cost;  here  by  the 
cost  of  a  system  of  representatives  we  mean  the  sum  of  the  costs  of  its 
elements.  It  is  easy  to  see  how  this  problem  also  fits  our  general 
pattern. 

Example  C.  The  Prime  Imp 1 leant  Problem.  Let  F  be  a  Boolean  function, 

IT,, ..  "TT„  its  prime  implicants,  and  p|t  its  canonical  terms 

or  states.  The  prime  implicant  table  for  F  is  defined  to  be  the  matrix  A 
whose  entry  a;j  is  I  if  implies  ,  and  o  otherwise.  The  prime 

implicant  problem  is  to  find  the  sets  of  columns  covering  A  having  as 
few  columns  in  them  as  possible  -  i.e.  letting  the  cost,  Y(S)  ,  of  a 
set  of  columns  be  the  number  of  columns  in  it,  the  problem  is  to  find 
the  ^-minimal  covers  of  A  . 

Evidently,  these  t  -minimal  covers  correspond  to  those  normal 
formulas  representing  F  which  consist  of  a  minimal  number  of  summands. 

Variations  in  the  problem  are  possible;  we  can  ask  for  the 
irredundant  covers,  for  example.  These  correspond  to  the  irredundant 
normal  formulas  representing  F  .  In  his  thesis  [la]  McCluskey  gives 
several  other  cost  functions  which  may  be  used. 

The  prime  implicant  problem  has  been  treated  extensively  by 
McCluskey  and  Pyne  in  their  two  papers  ([2],  [3])« 
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Example  D.  Minimal  Including  sums .  Let  "f(  be  a  set  of  Boolean 

formulas,  each  of  which  is  V  -irreducible,  i.e.  is  a  product,  and  let 
be  a  formula,  (or  function)  such  that  implies  f(  u  •  •  •  U  . 

Then  f  y...  is  called  an  Inc  luding  sum  for  c y  (the  fact  that  <j.  f 

is  also  sometimes  expressed  as  "  f  Includes  <^.  hence  the  name 
"Including  sum").  It  may  also  happen  that  <j.  Implies  a  "sub-sum" 
of  U  •  •  •  u  "fv,  .  Such  a  sub-sum  U •  •  •  U  is 

said  to  be  a  minimal  including  sum  for  (composed  of  one  or  more  of 

the  V i  )  if  a)  ^  implies  4^  u---  °  ,  and  b)  ^  implies  no  other 

proper  sub  sum  of  ^  U  •  •  •  U  . 

Denote  by  jo(  >  , , ,  f  y>w  the  canonical  states  of  .  Then  each  Ip ■ 
implies  4"  u  •  -  •  u  -f  •  We  define  a  matrix  A  as  follows  :  *  / 

*  W  V 

if  U.  implies  -f-  ,  and  a,..  ■=.  o  if  K-  does  not  imply  f:  .  Then  A  is 

i  4.  j  r  v 

a  matrix  of  o’o  and  ,  and  the  minimal  Including  sums  for  4  correspond 
exactly  to  the  irredundant  covers  of  A  . 

If  ^  is  equivalent  to  the  function  /  ,  then  •f.u  is 

equivalent  to  /  ,  also,  and  is  called  a  "sum-to-f  e."  In  this  case 

the  problem  is  to  find  the  minimal  sums-to-one  contained  in  ^  U  uf^  . 

The  problem  of  finding  the  irredundant  normal  formulas  representing 
a  given  function  is  evidently  a  special  case  :  for  this  we  would 
take  the  fj  to  be  the  prime  implicants  of  . 

We  may  formulate  the  problem  of  finding  the  prime  implicants  of  a 
given  function  F  as  a  problem  in  minimal  including  sums.  More  exactly, 
we  show  how  to  find  the  prime  implicates  of  the  dual  function,  SF. 

The  prime  implicants  of  F  are  then  the  duals  of  the  prime  Implicates 
of  sF  . 

We  take  for  C  the  set  of  literals  which  are  essential  to  F  ,  and 
for  R  any  set  of  terms  whose  union  is  a  normal  formula  representing  F. 
Then  the  set  of  literals  is  an  including  sum  for  F  ,  and  the  minimal 
Including  sums  are  the  prime  implicates  of  F  . 

The  theory  of  minimal  including  sums  has  been  developed  by  Samson 
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and  Calabi  [5],  and  haa  been  applied  in  [6]  to  the  determination  of 
higher  order  minimal  formu'as. 

Example  E.  Externally  atable  lets.  If  &  is  a  graph,  a  aet  T"  of 
vertices  is  called  externally  stable  if  each  vertex  of  ®  not  in  T 
is  joined  by  an  edge  of  &  to  at  least  one  element  of  T  .  A  minimal 
externally  stable  set  is  one  having  a  minimum  number  of  vertices.  The 
problem  is  :  find  the  minimal  externally  stable  sets  of  a  given  graph. 

To  see  that  this  la  a  special  case  of  our  general  problem,  we  take 

,  where  the  V*  are  the  vertices  of  5  ,  and 
we  define  CL-  to  be  /  if  and  Vj  are  joined  by  an  edge  of  Q  ^ 
and  ■=  o  if  v;  and  Vj  are  not  joined  by  an  edge  of  &  .  Then  each 

row  and  column  of  A  =  (o.^)  corresponds  to  a  vertex  of  &  .  If  we 
define  the  cost  of  a  set  of  columns  to  be  the  number  of  columns  in  the 
set,  we  obtain  a  cost  function  ^  ,  and  it  is  easy  to  see  that  the 
minimal  externally  stable  sets  of  G  are  in  one-to-one  correspondence 
with  the  if  -minimal  covers  of  A. 

The  algorithm  given  by  Berge  ([7] ;  pp. 1+2-43)  for  finding  a  minimal 
externally  stable  set  is  essentially  the  branching  method  to  be  dis¬ 
cussed  below. 

Example  F.  1 -widths  of  matrices.  The  concept  of  width  of  a  matrix 
of  zeros  and  ones  plays  an  important  role  in  many  combinatorial  problems 
of  current  interest  ([8]).  If  A  is  a  matrix  of  zeros  and  ones,  the 
1 -width  of  A  Is  by  definition  (transposed  into  our  terminology)  the 
smallest  number  of  columns  such  that  each  row  meets  at  least  one  of 
these  columns.  Rius  the  theory  of  1-widths  of  matrices  also  falls  within 
our  general  scheme. 

The  article  by  Edmonds  referred  to  in  Example  A  above  shows  that 
the  more  general  concept  of  -width  (cf  [8])  of  matrices  and  and  I  5 
also  can  be  formulated  as  a  covering  problem. 
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4.  Matrix  Formulation.  The  Halve  Solution.  Basically,  there  eve 
three  known  methods  for  the  solution  of  covering  problems:  the 
"naive"  solution,  the  Boolean  algebra,  or  "mul tip lying-out"  method, 
and  the  branching  technique. 

We  have  omitted  from  consideration  the  application  by  McCluekey 
and  Fyne  [16]  (see  also  Breuer,  [9])  of  linear  programming  techniques 
to  the  normal  minimization  problem.  This  technique  may  of  course  be 
applied  in  a  similar  fashion  to  find  the  -minimal  covers  of  a 
general  covering  matrix,  at  least  in  the  case  that  the  cost  of  a 
cover  is  the  sum  of  the  costs  of  the  columns  which  it  contains.  Certain 
serious  difficulties  (analyzed  in  [16])  are  encountered  in  the  use  of 
the  'classical'  linear  programming  techniques;  further  investigation 
devoted  to  the  resolution  of  these  difficulties  would  be  desirable. 

It  will  be  convenient,  for  our  subsequent  exposition,  to  have  the 
problem  formulated  in  matrix  terminology. 

Let  the  elements  of  R  be  and  those  of  C„  • 

The  matrix  A=  C  a.  j j )  of  the  relation  f  is  by  definition  given  by: 

«■/  if  Cj  6  f('f'i)  ,  and  if  cj  t  f(fi)  •  W* 

will  denote  the  rows  of  A  by  ,  .  •  ' ,  I*,  *nd  the  columns  of  A  by 
C  c  the  notation  was  originally  chosen  with  this  in  mind. 

i »  •  *  '  >  « 

We  say  that  row  r;  meets  column  £•  if  -  /  ,  i.e.  if  fLK t  J . 

A  cover  of  R  ,  or  as  we  shall  say,  of  A  ,  is  a  subset  C  of  the  set 
of  columns  of  A  such  that  each  row  in  ^  meets  at  least  one  colusm 
in  C1  .  The  translation  of  the  notions  of  irredundant  cover,  1*  -minimal 
and  -minimal  covers  into  the  terminology  of  rows  and  columns  Is 
simple. 

Now  it  is  well  known  that  the  Boolean  algebra  of  subsets  of  a 
given  set  C  is  isomorphic;  in  a  technical  sense,  to  the  Boolean 
algebra  of  h  -tuples  of  o’s  and  Is  ,  where  v»  is  the  number  of  elements 
in  G  .  The  explicit  description  of  this  isomorphism  will  yield  ti*  a 
way  of  transforming  our  covering  problem  into  the  problem  of  aolvieg 
a  certain  set  of  Boolean  equations. 
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Denote  byx/CC)  the  Boolean  algebra  of  subsets  of  C}  C*  cn\ 

and  by  8„  the  algebra  of  ft  -tuples  of  £>‘s  and  i!s  .  We  define  the 
map  >  B*  by  S— >  e&  =  yh  ),  where  *  > 

if  c-j  &  S  and  *  o  if  ^  ^  5  .  It  is  not  at  all  difficult  to 

see  that  the  Boolean  operations  of  union,  intersection  and  complementa¬ 
tion  are  preserved,  and  that,  in  the  technical  language,  £  is  an 
isomorphism  of  the  two  Boolean  algebras.  If  <f>  is  the  empty  subset,  Sp 
is  the  ft -tuple  consisting  entirely  of  zeroes;  the  subset  C  itself 
corresponds  to  the  Y)  -tuple,  (l),  consisting  entirely  of  /*  . 

Consider  the  system  of  equations 


(*) 

O',,  *. 

u  •  • 

-  u 

«  *  n 

=  '  ; 

J 

( 

|  ; 

• 

1 

'  a  * 

L  rr ,  i 

u  •  • 

•  u 

a  x 

»vi*  r\ 

=  (  . 

If  C  is  a  cover  of  1?  ,  then  the  components  ^ , ,  >  ■  ■ ,  of  the 

corresponding  n  -tuple  -•  •,  y „)  are  a  solution  of  the 

system  (*).  The  reason  for  this  is  that  if  a  row  If;  meets  Cj  S 

then  X--  -  I  ,  so  that  upon  substitution  of  the  for  the  Xj  in  (*), 

the  left  side  of  the  i  equation  becomes  CL‘t  ,  U’  •  •  U  U  ■  ■  ■  u 

and  since  A-  =/  ,  and  a^..  »  /  (  C;  being  an  element  of  C  ),  we 

have  that  a.-  •  m  ;  =■  /  ,  and  the  left  side  is  equal  to  /  .  Thus 
c  J  *«  ^ 

is  a  solution  of  the  l  equation  of  (*),  and  this  is 
so  for  each  i  .  Conversely,  it  is  easy  to  see  that  if  ) 

is  a  solution  to  (*),  the  corresponding  subset  C  of  C  ,  for  which 

,  is  a  cover  of  R  . 

Our  general  problem  (ill)  becomes  then: 

(ill')  Find  the  —  -minimal  solutions  of  the  system  (*). 

ll  *• 

It  should  be  remarked  that  our  assumed  pre-order  relation  — 
has  been  transported  bodily  from  the  collection  of  subsets 

of  C  to  the  corresponding  isomorphic  algebra  of  H  -tuples  -  we  say 
that  e  ±  e  ,  for  two  ft  -tuples  C"  and  C' ,  if  C  —  C  . 

c  c 
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The  first  method  of  solution  of  (ill1)  is  what  can  be  called 
the  "naive"  method.  It  consists  simply  in  examining,  one  after  the 
other,  the  various  h  -tuples  of  and  ls  to  determine  the  ones  which 
are  solutions  of  (*).  From  the  list  of  solutions,  the  ±-  -minimal 
covers  can  be  located  by  inspection.  We  have  already  mentioned  that 
this  exhaustive  method  is  not  generally  practical.  A  better,  but  still 
impractical,  way  of  proceeding,  would  be  to  solve  the  system  (*)  by 
some  algebraic  means,  analogous  perhaps  to  successive  elimination  of 
variables  in  solving  ordinary  simultaneous  systems  with  real  coefficients. 
Techniques  for  solving  linear  Boolean  equations  are  known;  they  do  not 
seem  as  yet  to  have  been  considered  in  connection  with  covering  problems. 
This  seems  to  be  a  potentially  useful  direction  for  future  work. 

If  just  one  —  -minimal  cover  is  wanted,  the  naive  method  may 
sometimes  be  useful.  We  have  in  mind  the  case  that  —  is  derivable 
from  a  cost  function  V-  ,  with  the  cost  of  a  cover  being  given  as  the 
sum  of  the  costs  of  its  columns.  The  procedure  is  to  examine  in  succes¬ 
sion  sets  of  columns,  starting  with  those  of  cardinality  i  ,  then  those 

with  two  columns,  and  so  on.  Each  time  that  a  cover  is  found,  its  cost 

is  recorded,  and  compared  with  the  costs  of  those  already  found.  The 
procedure  is  carried  out  to  the  point  at  which  it  can  be  determined  that 
the  cost  of  any  set  of  columns  of  larger  cardinality  would  be  larger 
than  the  minimum  cost  so  far  recorded.  At  this  point,  the  recorded  cover 

of  smallest  cost  will  be  the  desired  minimal  cover  of  A  . 

5*  The  Boolean  Algebra,  or  Prime  Implicant  Method.  This  method  is 
based  on  the  following  theorem,  which  shows  that  the  irredundant  covers 
of  'R  are  in  one-to-one  correspondence  with  the  prime  implicants  of  a 
certain  Boolean  formula  associated  to  the  matrix  A  .  Here,  the 
are  the  entries  of  A  . 

Theorem:  Define  the  Boolean  formula,  F(A}  ,  by: 

F(  A  ^  ss.  Ct  U  •  •  •  £L(n  Cm  )  •  •  C  ft-rni  C/  u  ^  ‘“u  ^  a 
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whore  wo  have  used  the  letters  t0  denote  both  the  columns 

of  A  ,  and  Boolean  literals .  Then  C'=  ?  Is  an 

irredundant  cover  of  A  if  and  only  if  the  formula  F(C‘)»  C/  ...  d¥ 
is  a  prime  implicant  of  F(A)  . 

Proof;  We  show  that,  in  general,  a  subset  •>=  \  C£  ,  ..  . ,  } 

of  G  is  a  cover  of  A  if  and  only  if  the  formula  F(S )  »  C;t  •  •  •  Cj 
is  an  implicant  of  F(  A)  (  i.e.  FCS)  =5>  FC  A  ))  .  Well,  if  S  -  $citi  •  •  •, 

is  a  cover  of  A  ,  then  A(eg)  =  (  l)  ,  so  that  the  system  (*)  is 

satisfied,  with  e$  =  l  y ,  ,  .  .  .  >  ?  •' 

—  u ^  9  h 

'  ,  U  ’  ‘  ’  U  n  I  • 

Thus  (a ?„)•••  (&mi  u  CL^  y  J  =  I. 

now  the  expression  on  the  left  here  is  that  obtained  by  substituting  /w- 
for  Cj  in  F(A)  ,  for  ^=1,  « • -,  »»  .  Since  =  /  if  and  only  if 
C‘  6  S  ,  it  follows  that  the  formula  F(S)  s*  c«:(  ,  .  C£t  takes  the 
value  one  only  upon  this  same  substitution  of  the  yj  for  C*  .  Thus 
the  product  F(^)  =  Cj  ■  -  -  Cif  implies  F( A)  ,  and  PCS)  is  an 

implicant  of  F(a)  .  A  reversal  of  the  argument  shows  that  conversely, 

if  FCS)  is  an  implicant  of  F(A)  then  S  is  a  cover  of  A  .  Thus  the 
problem  of  finding  irredundant  covers  is  transformed  into  the  problem 
of  finding  the  prime  implicants  of  a  certain  formula  given  as  the 
product  of  sums  of  literals,  i.e.  the  problem  of  finding  the  star 
formula  F*(A)  of  F(A)  .  The  existing  known  methods  for  finding 
prime  implicants  can  then  be  brought  to  bear.  In  particular,  since  F(A) 
does  not  contain  complements,  F*YA)  may  be  found  by  first  multiplying- 
out  F(A)  and  then  simplifying  by  deleting  redundant  terms  and  literals. 

We  remark  that,  as  we  have  seen  in  the  discussion  of  the  examples, 
the  problem  of  finding  the  prime  implicants  of  a  function  can  Itself  be 
formulated  as  a  covering  problem,  so  that  any  progress  in  finding  better 
algorithms  for  computing  £  -minimal  covers  would  lead  to  improved 
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methods  for  finding  prime  implicants. 

The  theorem,  in  the  special  case  of  irredundant  normal  formulas, 
is  implicit  in  the  work  of  Samson  and  Mueller  [10];  the  first  explicit 
statement  and  proof  seems  to  have  been  given  by  Petrick  [11].  The 
presence -function  defined  by  Gasale  [12]  is  also  a  function  whose 
prime  implicants  correspond  to  irredundant  normal  forma  (his  derivation 
of  it  is  somewhat  different,  however,  and  belongs  more  properly  to  the 
situation  of  minimal  including  sums  discussed  below  in  section  7)* 

6.  Branching  Methods.  Consider  the  system  (*)  of  equations  for  the 
covering  problem: 


(*) 


O',,  *,  u 


u 


x* 


u  ■■  ■  u  x„  »  / 


It  is  a  trivial,  but  as  this  section  will  demonstrate,  an  extremely 
useful  observation  that  an  irredundant  solution  of  (*)  either  will 
have  Xn  =  /  ,  or  will  have  &  .  This  suggests  that  we  split  the 

problem  (*)  up  into  two  smaller  ones,  viz.  first  find  those  irredundant 
covers  of  A  ,  if  any,  which  do  not  contain  column  C„  }  and  then  find 
those,  if  any,  which  do.  In  order  to  describe  the  procedure  we  need 
a  bit  more  notation.  We  will  denote  the  set  of  -minimal  covers  of 
a  matrix  A  by  Mc  -Cw  ,  where  are  the  columns  of  A* 

If  C;  is  a  particular  column  of  A  ,  we  denote  by  M 


•  C. 


the 


set  of  —  -minimal  covers  of  the  matrix  obtained  from  A  by  deleting 
not  only  column  C;  but  also  by  deleting  in  addition  those  rows  of  A 


which  meet  C: 


Thus,  for  example, 


'C' 


if  a ) 

\oo  n  J 


,  I 

,  with  columns  C(  *  [  ; 

1  o 


-( 


etc.,  then  hA  1  is  the  set  of  i  -minimal  covers  of  the  matrix  /' 

C,CVC,C^  7  l  o 


Then  our  previous  remark  may  be  rendered  symbolically  as  follows:  the 
f.  -minimal  covers  of  A  which  do  not  contain  column  C„  are  exactly 
the  covers  in  the  set  M.  .  ,  the  ^  -minimal  covers  of  A 

ci  ^ 

which  do  contain  are  the  covers  in  the  set  .  Then 

we  may  express  the  solution  fAc  t  bo  the  covering  problem  in  the 
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following  form: 

(**>  c.  -  »..•»$*«„  ;  *.  '  <,~c. 

Here  by  we  mean  the  collection  of  aeta  $  cM]  S' 

where  S'  rangea  over  the  aeta  in  MC)iitC„  .  Here,  also,  by  bu'ti  [X 

)  ^ 

we  mean  the  collection  of  .f*  -minimal  aeta  in  XUY, 

The  formula  (**)  ia  intuitively  obvloua:  a  ±  -minimal  cover  of  A 
either  does  not  contain  C„  ,  or  elae  it  la  compoaed  of  c„  together 
with  a  ±.  -minimal  cover  of  thoae  rowa  not  already  covered  by  C„  ,  i.e. 
those  rows  not  meeting  c„  , 

The  two  sub -problems  are  each  of  a  smaller  order  than  4  ,  the 
one  having  one  column  less,  and  the  other  having  not  only  one  column, 
but  also  at  least  one  row  less. 

Further  simplification  may  be  had  by  iterating  formula  (**).  We 
have  for  example,  selecting  column  C„_,  as  the  next  "pivot:" 

V-«.  *  I*1" c*" •  ■  • 

s 


This  may  be  written,  using  obvious  properties  of  the 


operation, 


(***)  M,  c  »  i  •  M  •  M  c  \  - 

It  is  necessary  to  point  out  that  a  sub-problem  obtained  by  this 
type  of  deletion  may  have  no  solutions.  We  have  not  mentioned  it  before, 
but  it  is  not  difficult  to  see  that  a  system  of  equations  (*)  will 
fail  to  have  a  solution  if  and  only  if  some  row  of  the  matrix  A  con¬ 
sists  entirely  of  zeros.  For  example,  if  in  (***)  C„  and  were 

the  only  columns  meeting  some  row  of  A  »  then  M.  r  would  be  . 

S’" 

In  this  case  (#**)  would  reduce  to 

K  ,  -  wiJnfc.  •  M?-*  ,  C„  •  Mc‘-  }  . 
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=  miw 


In  practice  we  may  use  this  iterative  simplification  by  choosing 
for  successive  pivots  all  of  the  columns  which  meet  a  chosen  row  of  A. 
Ve  obtain  then  a  determinate  set  of  simpler  problems,  and  we  are  sure 
that  a  ±  -minimal  cover  of  the  original  matrix  A  must  be  a  —  -minimal 
cover  of  one  at  least  of  these  sub -matrices. 

Another  practical  method  of  procedure  is  the  following.  First 
choose  an  irredundant  cover  of  A  ,  and  re-arrange  the  columns  of  A 
so  that  those  in  the  cover  are  the  first  r  columns 
Then  ig  the  only  cover  of  the  matrix  L  c,  Cr  1, 

i.e.  M  ,  =  C . ,  Cr  ?  •  Now  consider  the  problem  _ 

V  13  IT!  — 4‘*'CrCr*/ 

By  (**)  the  £  -minimal  covers  of  this  are: 

Having  these,  we  repeat  the  procedure,  adjoining  the  next  column 
of  A  ,  using  (**)  again,  and  so  on. 

There  are  other  variations  which  may  be  made  in  using  the  branching 
technique  in  specific  problems.  A  good  summary  of  various  procedures 
can  oe  found  in  the  papers  of  McCluskey  and  Pyne  ([la]-[lc]).  In 
section  2  above  we  have  pointed  out  that  Roth's  extraction  algorithm 
is  basically  the  same  as  the  branching  technique.  Menger's  procedures 
[13]  for  finding  minimal  normal  formulas  seem,  also,  to  consist  among 
other  simplifications,  in  an  ingenious  adaptation  of  the  branching  tech¬ 
nique. 

7.  An  application  to  minimal  including  sums .  The  Gazale-Rado/  Technique 


Let  be  a  set  of  formulas  and  TJ)  , . . . ,  7TM  a  set  of  terms 

such  that  V%  u  <  •  ’  u  7^,  f,  1/  •  •  •  U  ^  ,  The  problem  of  minimal  includ¬ 
ing  sums  for  1T4  u  TTW  is  as  we  have  seen,  to  find  those  "sub-sums" 
of  f(  u  which  are  also  implied  by  each  TT*  ,  and  which  have  the 

property  that  none  of  their  proper  sub-sums  are  implied  by  TIJ  U’-  uW^, 
The  usual  formulation  of  this  as  a  covering  problem  uses  the  matrix  A 
whose  entry  is  /  if  ,  and  o  otherwise.  The  following 

theorem  shows  that  we  may  solve  the  problem  in  essentially  the  same 


-20- 


Puu  Mathematical  Laboratories,  Incorporated  2bl7-SR-2 

ONE  RIVER  ROAD  •  CARLISLE.  MASSACHUSETTS 


manner  as  our  previous  covering  problems,  except  that  now  we  admit  the 
use  of  matrices  whose  entries  are  not  necessarily  O  or  /  ,  but  may 

be  any  Boolean  function.  We  need  to  define  some  terms  occurring  in  the 
statement  of  the  theorem. 

Denote  by  4}  (  7T;  )  the  function  obtained  from  by  substituting  /,  0 
(according  as  the  corresponding  literal  is  X  or  x  )  for  the  variables  * 
which  occur  in  TT*  ,  and  leaving  the  rest  of  the  variables  in  4;  un¬ 
touched.  If  TT  is  X  x4  ,  for  example,  and  -fj  is  X.X^x,  O  \  ,  then  f-j  (V't) 

is  the  function  I .  o  ■  O  =  W  • 

We  define  the  matrix  B  by  stipulating  that  its  entry  shall 
be  f.CTT,;)  .  We  label  the  columns  b  and  consider  the  kj  also 

as  Boolean  literals.  If  J  ,  ,  ,,  i>jr  I  is  any  set  of  columns,  we 
denote  by  F(?>)  the  product,  r(?)4;  ...  b;r  of  the  literals  correspond¬ 
ing  to  these  columns.  If  ^  =  4 ^  U  •  •  ■  V  4 ir  is  a  sub-sum  of  4*  0  ■  •  •  j  %  ^ 
we  let  this  correspond  to  the  set  S' =  £  Wj  >  ..  , ,  ;  of  columns.  The 

formula  F(S)  is  then  the  product  of  the  literals  bt-  ,  . . .  b ;  correspond- 

.  1  r 
ing  to  the  suimnands  of  0  •  •  •  O'  ^ ir  . 

Denote  by  S:  the  minimal  including  sums-to-one  in 


the  i  ^  row  of  3 


we  recall  that  this  means  the  minimal  including 
sums  for  the  function  /  ,  which  in  our  case,  since  TT,  u  •  •  •  ~-s  + 

is  the  union  of  the  entries  in  the  iH  row  of  8  .  Finally, 

we  denote  by  F(B)  the  formula  defined  as  follows: 

F(  B )  »  (  F  C  SM )  j  ■  •  ■  u/'  F(  ?it' ))  '  *  F(S*,rj). 


The  statement  of  the  theorem  is: 

Theorem.  The  sub-sum  5  =  fk-;U  •  •  •  U  is  a  minimal  including  sum  for 

•TT  u •  • »  u Hm  if  and  only  if  F(S)  is  a  prime  implicant  of 

The  proof  follows  the  same  pattern  as  that  of  our  previous  theorem 
concerning  the  relation  between  prime  implicants  and  irredundant  covers. 

Thus,  let  S-4-^  U  ■  ■  ■  u  nr  be  a  sub-suin  of  T  u---  u  such  *  ’-it 

F(^)  =??  F(  .  Then  Rb}  =>  F C c/  -  -  -  f  F(S;c  j  for  each  :  , 

and  since  these  formulas  contain  no  complements,  F(S^)  i;;r 
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some  %  .  Thus  the  columns  corresponding  to  5\:j6  are  among  those 
corresponding  to  S  .  Thus  we  see  that  for  each  row,  there  Is  a 
minimal  sum-to-one  whose  corresponding  columns  are  a  subset  of  the 
columns  y-,  *  But  this  then  leads  immediately  to  the  Implica¬ 
tion  TT(  u  •  ■  •  u  TT^  U  ■  ■  ■  U  .  Thus  we  have  shown  that  each  sub- 

sum  of  such  that  F(£ \}  ,  . ^  )  =)>  F(.B)  Is  an  including 

sum  for  TT,  u  •  •  *  u  TTm  .  Conversely,  a  similar  proof  will  show  that 
if  S  =  u  •  •  -  u  is  an  including  sum  for  TT  u  •  •  •  o  JT  ,  then  F(s) 
is  an  implicant  of  F(&)  .  It  follows  that  the  minimal  including 
sums  correspond  to  the  prime  implicants,  and  vice  versa. 

We  close  with  several  remarks  dealing  with  the  application  of  this 
theorem. 

The  usual  applications  of  the  technique  of  minimal  including  sums, 
for  example,  finding  irredundant  normal  formulas,  start  with  the 
canonical  sum  of  states  representing  the  given  function.  In  the  prime 
implicant  problem,  likewise,  the  rows  of  the  prime  implicant  table 
correspond  to  states  or  canonical  terms.  The  preceding  theorem  shows 
that  we  may  use  any  normal  formula  representation  of  the  function  to 
represent  the  rows  of  our  matrix  5  .  Thus,  the  sunmands,  TT^  ,  of 
the  given  normal  formula  would  correspond  to  the  rows  of  6  ,  and  the 
prime  implicants  of  the  function  would  correspond  to  the  columns. 

Since,  in  general,  we  can  obtain  a  normal  formula  which  has  fewer 
summands  than  states,  we  see  that  B  has  fewer  rows  than  the  usual 
covering  matrix  A  would  have.  This  means  a  saving  in  the  amount  of 
work  necessary  -  in  particular,  the  formula  F(h)  will  have  fewer  factors 
to  be  multiplied-out . 

Off-setting  this  advantage,  however,  is  the  fact  that  this  more 
general  procedure  requires  the  computation,  for  each  row  of  6  ,  of 
all  of  the  minimal  including  sums  of  functions  in  that  row.  This  may 
very  well  amount  to  more  work,  for  some  problems,  than  using  the 
larger  number  of  rows  corresponding  to  the  states,  but  together  with 
entries  of  o  and  |  ,  only,  in  B. 
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There  are  ways  of  getting  around  the  difficulty,  but  we  have 
not  yet  investigated  them  to  the  extent  sufficient  to  decide  whether 
they  are  really  worthwhile  or  not. 

The  entries  ^-(TT^  of  the  matrix  B  are  what  would  have  been 
called  "ratios"  by  Gasal^,  end  would  have  been  denoted  by  j 

see  [12].  G&tale  however  considered  only  terms  for  the  ;  in 
this  respect  our  procedure  is  an  extension  of  his.  Rado  [14],  in 
his  treatment  of  the  general  "presence"  function,  gives  a  proof  of 
our  theorem  in  the  special  case  that  the  £  TT,;^  are  all  of  the  canoni¬ 
cal  states  for  the  function  ■?,  U  •  •  •  u  4^  , 
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There  are  ways  of  getting  around  the  difficulty,  but  we  have 
not  yet  investigated  them  to  the  extent  sufficient  to  decide  whether 
they  are  really  worthwhile  or  not. 

The  entries  fj(H i)  of  the  matrix  B  are  what  would  have  been 
called  "ratios"  by  Gazale',  snd  would  have  been  denoted  by  fi/fl£  • 
see  [12].  Gazale/ however  considered  only  terms  for  the  ;  in 
this  respect  our  procedure  is  an  extension  of  his.  Rado  [14],  in 
his  treatment  of  the  general  "presence"  function,  gives  a  proof  of 
our  theorem  in  the  special  case  that  the  £  are  all  of  the  canoni¬ 

cal  states  for  the  function  4 ,  O  •  •  •  u  4^  . 
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